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TITLE OF 
IMAGE DATA PROCESSING 

MEDIUM 



THE INVENTION 

APPARATUS, METHOD, STORAGE 
AND PROGRAM 



5 FIELD OF THE INVENTION 

This invention relates to a processing technique 
for processing image data. 



BACKGROUND OF THE INVENTION 

10 Improvements in the capabilities of image data 

processing devices such as printers and digital 
cameras in recent years have been accompanied by 
utilization of color space of wider color gamuts in 
the processing of image data. 

15 In a digital camera, for example, color 

correction processing is executed in a color space 
having a wide color gamut, examples of such a color 
space being sRGB and Adobe RGB. The flow of image 
processing in a digital camera having a color 

20 correction processing function disclosed in the 

specification of Japanese Patent Application Laid-Open 
No. 2003-198909 will be described with reference to 
Fig. 17 as an example of such processing. 

As shown in Fig. 17, light is introduced to the 

25 lens of a digital camera in response to pressing of a 
shutter-release button (step S1701), and the incident 
light is made to impinge upon a sensor such as a CCD 



- 1 - 



CFM03424/P203-0568 



or CMOS so that the optical signal is converted to an 

RGB digital signal (step S1702). 

Next, this digital image data is subjected to 

interpolation processing followed by processing such 
5 as white-balance processing (step S1703). The image 

data that has undergone interpolation processing is 

subjected to a color correction by sRGB color space or 

by the wider Adobe RGB color space based upon a 

designation made by the user (step S1704). (For 
10 reference purposes, the color gamuts of sRGB color 

space and Adobe RGB color space are indicated at 1601 

and 1602 in Fig. 16. ) 

After the color-corrected image data is subjected 

to gamma processing in conformity with the monitor 
15 output (step S1705), the image data is subjected to 

JPEG (Joint Photographic Experts Group) compression 

(step S1706). One series of image processing 

operations is thus completed. 

Thus, in the case of a digital camera, color 
20 correction processing utilizing a color space having a 

wide color gamut is executed in image processing up to 

the compression and storage of image data captured by 

photography. 

In recent years, not only widening of color- space 
25 color gamut but also higher tonality is sought in 

processing of image data in an image data processing 
apparatus. For this reason, an improvement in the bit 
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precision of image data processed is contemplated for, 
e.g., printers, for the purpose of widening the color 
gamut of color space and raising tonality. 

In the case of a printer, however, when image 
5 data is subjected to print processing based upon a 

high bit precision, a problem which arises is that if 
the printing medium is of low quality, print 
processing takes an inordinately long period of time 
considering the low quality of the printed results . 

10 In other words, as far as the user is concerned, the 
desired printed result is not obtained despite the 
fact that print processing is executed over an 
extended period of time. 

In view of these circumstances , lowering the bit 

15 precision has been considered as a measure to shorten 
the time needed for print processing. However, if bit 
precision is simply lowered under a wide color gamut, 
tonality will decline. That is, in a case where bit 
precision is raised in order to realize a wider color 

20 gamut and higher tonality in a printer, implementing 

this upon taking into account a balance between print - 
processing time and quality of printed results is 
preferred in view of suitability to user needs . 

Similarly, in the case of a digital camera, it is 

25 necessary to take into account the balance between 
color gamut and tone in regard to realizing a wide 
color gamut and higher tonality. For example, as 
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mentioned above, the color space used in the color 
correction of step S1704 is specified by the user. 
Since the JPEG scheme has a bit precision of eight 
bits, however, the color gamut of the captured image 
5 data will widen but tonality will decline if Adobe RGB 
color space is specified by the user. Such a decline 
in tonality becomes especially conspicuous in cases 
where the subject of photography is a human being. 
More specifically, in a case where color- 

10 correction processing using sRGB color space and 
color-correction processing using Adobe RGB color 
space is performed with same bit precision, the color- 
correction processing using sRGB color space provides 
better tonality than the color-correction processing 

15 using Adobe RGB color space. 

This means that in a case where the subject is 
something other than a human being, such as scenery, 
color gamut should be emphasized and Adobe RGB color 
space specified. On the other hand, if the subject is 

20 a human being, the tonality of skin color should be 
emphasized and sRGB color space should be specified. 

Thus, with regard to widening color gamut and 
improving tonality in a digital camera, implementing 
this upon taking into account the nature of the 

25 subject is preferred in view of suitability to user 
needs . 
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SUMMARY OF THE INVENTION 
Accordingly, an object of the present invention 
is to widen color gamut and improve tonality in 
processing of image data in an image data processing 
5 apparatus, and to execute image processing that is 
suited to user needs. 

More specifically, an object of the present 
invention is to realize higher speed while widening 
color gamut and improving tonality in processing for 
10 printing image data. 

A further object of the present invention is to 
widen color gamut and improve tonality suitably in 
accordance with the subject of photography in 
processing for applying a color correction to image 
15 data that has been captured by photography. 

According to the present invention, the foregoing 
objects are attained by providing an image data 
processing apparatus for processing image data to be 
printed , comprising : 
20 a print -quality acquisition unit adapted to 

acquire information relating to print quality; and 

a selection unit adapted to select a combination 
of a color space and bit precision to which the image 
data to be printed will be converted, based upon the 
25 acquired information relating to print quality; 

wherein the image data is converted to the color 
space and bit precision selected by the selection unit. 
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By virtue of this arrangement, it is possible to 
select a color space and bit precision, which are used 
in processing at the time of printing, in accordance 
with information relating to print quality (e.g., type 
5 or resolution of the medium on which printing is 
performed) . This makes it possible to provide an 
environment in which printing is performed with a wide 
color gamut for high-quality media, though processing 
time is prolonged, whereas high-speed printing can be 

10 carried out with regard to low- quality media. 

More specifically, in the case of high-quality 
media, for example, processing with a high bit 
precision is executed in color space having a wide 
color gamut. In the case of low-quality media, 

15 processing is executed at high speed and bit rate is 
therefore lowered. However, in order to suppress a 
decline in tonality, color space is compressed and 
processing is executed using a smaller color space. 
Further, according to another aspect of the 

20 present invention, the foregoing objects are attained 
by providing an image data processing apparatus 
comprising: 

a photography mode setting unit adapted to set a 
photography mode at the time of photography; 
2 5 a photography unit adapted to photograph a 

subject based upon the set photography mode; 
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a selection unit adapted to select a color space 
from a plurality of color spaces with a different 
color gamut in accordance with the photography mode; 
and 

5 a color conversion unit adapted to convert the 

color space of the photographed image data into the 
selected color space. 

Other features and advantages of the present 
invention will be apparent from the following 
10 description taken in conjunction with the accompanying 
drawings , in which like reference characters designate 
the same or similar parts throughout the figures 
thereof . 

15 BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorporated 
in and constitute a part of the specification, 
illustrate embodiments of the invention and, together 
with the description, serve to explain the principles 

20 of the invention. 

Fig. 1 is a block diagram illustrating the system 
configuration of an image data processing apparatus 
according to first to third embodiments of the present 
invention; 

25 Fig. 2 is a diagram illustrating the essentials 

of a media information database in which color space 
and bit precision used in processing at the time of 
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printing are registered on a per -medium basis in the 
image data processing apparatus according to the first 
embodiment of the present invention; 

Fig. 3 is a diagram illustrating the essentials 
5 of a printing application used in the image data 

processing apparatus according to the first embodiment 
of the present invention; 

Fig. 4 is a flowchart for describing a process 
through which color space and bit precision used in 
10 processing at the time of printing are selected in 
accordance with the medium in the image data 
processing apparatus according to the first embodiment 
of the present invention; 

Fig. 5 is a flowchart for describing the flow 
15 print processing in the image data processing 

apparatus according to the first embodiment of the 
present invention ; 

Fig. 6 is a flowchart for describing a process 
through which color space and bit precision are 
20 selected in accordance with the resolution at the time 
of printing in an image data processing apparatus 
according to a second embodiment of the present 
invention; 

Fig. 7 is a flowchart for describing a process 
25 through which a JPEG image is printed in an image data 
processing apparatus according to a third embodiment 
of the present invention; 
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Fig. 8 is a diagram illustrating a conversion 
method when 8 -bit YCbCr data is converted to Wide 
Gamut RGB 16 -bit data; 

Fig. 9 is a flowchart illustrating image data 
5 processing executed by an image data processing 
apparatus (digital camera) according to a fourth 
embodiment of the present invention; 

Fig. 10 is a block diagram illustrating the 
system configuration of a digital camera; 
10 Fig. 11 is a perspective view illustrating the 

external configuration of a digital camera; 

Figs. 12A to 12D are an explanatory views 
illustrating photography modes; 

Fig. 13 is a perspective view illustrating the 
15 back side of the digital camera; 

Fig. 14 is an explanatory view illustrating color 
space modes also on an operation display; 

Fig. 15 is a flowchart illustrating image data 
processing executed by an image data processing 
20 apparatus (digital camera) according to a fifth 
embodiment of the present invention; 

Fig. 16 is an explanatory view illustrating the 
color gamuts of sRGB color space and Adobe RGB color 
space; and 

25 Fig. 17 is a flowchart illustrating image data 

processing in a digital camera according to the prior 
art . 



- 9 - 



CFM03424/P203-0568 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Preferred embodiments of the present invention 
will now be described in detail in accordance with the 
5 accompanying drawings . 

[First Embodiment] 

This embodiment will be described with regard to 
a case where printing is performed upon selecting 
color space and bit precision in accordance with the 
10 type of medium on which printing is performed (i.e., 
in accordance with information relating quality of 
printing). 

Fig. 1 is a block diagram illustrating the system 
configuration of an image data processing apparatus 

15 according to first to third embodiments of the present 
invention. (It should be noted that this image data 
processing apparatus may function as part of a printer 
or may function as a separate apparatus that is 
connected to a printer. The same will hold true in 

20 second and third embodiments.) 

As shown in Fig. 1, the apparatus includes an 
input unit 101 for entering commands and data from a 
user and includes a pointing system such as a keyboard 
and mouse. A display unit 102, which is a device that 

25 displays a GUI (Graphical User Interface) and the like, 
usually employs a CRT or liquid crystal display. A 
storage device 103 stores image data and programs and 
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usually employs a hard disk. A CPU 104 executes all 
processing involving the components mentioned above. 
A ROM 105 and a RAM 106 provide the CPU 104 with 
programs, data and working areas necessary for the 
5 above processing. It is assumed that a control 
program necessary for processing indicated by a 
flowchart described below has been stored in the 
storage unit 103 or in the ROM 105. In a case where 
the control program has been stored in the storage 

10 unit 103, the program is executed upon storing it 
temporarily in the RAM 106. 

It should be noted that the system configuration 
of the image data processing apparatus according to 
this embodiment includes various components other than 

15 those mentioned above. However, as these other 
components do not have a direct bearing upon the 
present invention, they are not described here. 

Fig. 3 is a diagram illustrating the essentials 
of a printing application used in the image data 

20 processing apparatus according to this embodiment. In 
a printing application 301, the printer to be used in 
printing is selected and a print setting button is 
pressed, whereby a print setting dialog screen 302 is 
displayed. This makes it possible to set media, 

25 printing mode and paper size. By pressing a print 

button 303 upon completion of the settings, printing 
of the image starts. 
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Fig. 2 is a diagram illustrating the essentials 
of a media information database 201 in which a 
combination of color space and bit precision used in 
processing at the time of printing is registered for 
5 every printing medium. In the case of low-quality 
media, such as plain paper or postcards, sRGB is 
registered as the color space and 8 bits as the bit 
precision. In the case of high-quality media, xRGB , 
which has a color gamut wider than that of sRGB, is 

10 registered as the color space, and 16 bits as the bit 
precision. In other words, the media information 
database 201 has a plurality of combinations in which 
the size of color space and bit precision both differ, 
and at least one combination from among these 

15 combinations has a lower bit precision and a wider 

color gamut in comparison with the other combinations . 
It should be noted that xRGB signifies, e.g., Wide 
Gamut RGB or Adobe RGB color space, etc. Wide Gamut 
RGB is a color space which has a color gamut wider 

20 than that of sRGB as well as Adobe RGB. A conversion 
method for conversion from YCbCr to Wide Gamut RGB is 
shown in 801 of Fig. 8. 

Fig. 4 is a flowchart for describing a process 
through which color space and bit precision used in 

25 processing at the time of printing are selected in 

accordance with the medium on which printing is to be 
performed. At step S401, a medium name that has been 
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specified on the print setting dialog screen 302 is 
acquired. This is followed by step S402, at which 
reference is had to the media information database 201 
using the medium name required. Based upon the result 
5 of the reference made, it is determined at step S403 
whether there are a color space and bit precision 
linked to this medium name. Control proceeds to step 
S404 if a color space and bit precision linked to the 
medium name exist, and to step S406 if these do not 
10 exist. 

It is determined at step S404 whether the linked 
color space and bit precision are sRGB and eight bits, 
respectively. Control proceeds to step S405 in case 
of sRGB and eight bits, and to step S406 if the linked 

15 color space and bit precision are not sRGB and eight 
bits, respectively. 

At step S405, sRGB and eight bits are selected, 
after which processing is exited. At step S406, xRGB 
and 16 bits are selected, after which processing is 

20 exited. Thus, by using the media information database, 
a color space and bit precision that are optimum for 
the specified printing medium can be selected. 

Fig. 5 is a flowchart for describing a process 
through which printing is actually performed using the 

25 printing application 301. At step S501, the print 
setting dialog screen 302 is opened by the user and 
the printing settings are made. This is followed by 
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step S502, at which the user presses the print button 
303 to start print processing. Image data to be 
printed is then entered at step S503. Here it is 
assumed that the entered image data is image data in a 
5 color space (xRGB) having a color gamut wider than 

that of sRGB and that the data has a bit precision of 
16 bits for each value of R, G, B. 

Next, at step S504, print settings (medium, 
printing mode, paper size), which have been made using 

10 the print setting dialog screen 302, are acquired. 

Then, at step S505, the medium name is extracted from 
the acquired print settings, and color space and bit 
precision used at the time of printing are selected by 
the flowchart of Fig. 4. 

15 It is determined at step S506 whether the 

selected color space and bit precision are xRGB and 16 
bits, respectively. If the selected color space and 
bit precision are xRGB and 16 bits, respectively, then 
control proceeds to step S507. Otherwise, control 

20 proceeds to step S508. 

At step S507, a color transformation is 
unnecessary and therefore an image correction for 
enhancing the appearance of the image data is 
performed with respect to 16 -bit xRGB color space. On 

25 the other hand, in order to process the xRGB 16 -bit 

image data at high speed, a conversion is made to sRGB 
and eight bits at step S508. Furthermore, at step 
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S509, an image correction in order to enhance the 
appearance of the image data is performed with respect 
to the 8 -bit sRGB data. 

The corrected data is converted to Device RGB 
5 color space at step S510. Then, at step S511, Device 
RGB is converted to CMYK. Printing is executed at 
step S512 using the CMYK data. 

Thus, in accordance with this embodiment, as 
should be evident from the above description, a wider 

10 color gamut and a higher tonality are achieved using a 
high bit precision in the case of a high-quality 
printing medium. On the other hand, in the case of a 
low-quality printing medium, the image data is 
compressed to a color space of a narrower color gamut 

15 and to a lower bit precision, whereby print processing 
can be executed at high speed while a decline in 
tonality is suppressed. Thus, processing suited to 
the needs of the user becomes possible. 
[Second Embodiment] 

20 According to the first embodiment, bit precision 

and color space are selected in dependence upon the 
medium on which image data is to be printed. However, 
this does not impose a limitation upon the present 
invention. In the second embodiment, a case where 

25 printing is performed upon selecting color space and 
bit precision in accordance with resolution at the 
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time of printing (information relating to printing 
quality) will be described. 

If resolution at the time of printing is low, the 
results of printing will be of low quality and even if 
5 printing of a wide color gamut is performed, the 

effect of this will not manifest itself. In a case 
where resolution is low, therefore, performing 
printing at high speed is better suited to user needs 
than performing printing that emphasizes a wide color 
10 gamut. 

Since the system configuration of the image data 
processing apparatus according to this embodiment is 
that same as that of the first embodiment, it need not 
be described here. 

15 Fig. 6 is a flowchart for describing a process 

through which color space and bit precision employed 
in processing at the time of printing are selected in 
accordance with resolution at the time of printing. 
This flowchart corresponds to the processing of step 

20 S505 in the flowchart for print processing depicted in 
Fig. 5. 

Step S601 in Fig. 6 calls for the acquisition of 
area information (vertical length x horizontal length) 
in centimeter units of the print area. Step S602 
25 calls for the acquisition of area information (number 
of pixels vertically x number of pixels horizontally) 
in pixel units of the print area. Resolution (cm/pix) 
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at the time of printing is calculated based upon the 
acquired area information (centimeters and number of 
pixels) at step S603. 

It is determined at step S604 whether the 
5 resolution calculated at step S603 is equal to or 
greater than a predetermined threshold value N. 
Control proceeds to step S605 if the resolution is 
equal to or greater than the threshold value N, and to 
step S606 if the resolution is less than the threshold 

10 value N . 

Since printing can be performed at a high 
resolution and high quality, xRGB and 16 bits are 
selected at step S605, after which processing is 
exited. At step S606, on the other hand, printing can 

15 only be performed at a low resolution and low quality 
and, hence, sRGB and eight bits are specified, after 
which processing is exited. 

Thus, in accordance with this embodiment, as 
should be evident from the above description, a wider 

20 color gamut and a higher tonality are achieved using a 
high bit precision in a case where printing resolution 
is high and quality high at the time of printing. On 
the other hand, in a case where printing resolution is 
low and quality low at the time of printing, print 

25 processing is executed at high speed while a decline 

in tonality is suppressed by compressing image data to 
color space having a narrow color gamut and a low bit 



- 17 - 



CFM03424/P203-0568 



precision. Thus, processing suited to the needs of 
the user can be executed. 
[Third Embodiment] 

The first embodiment has been described in regard 
5 to a case where the entered image data is xRGB 16 -bit 
data. However, in the third embodiment, a case where 
decoded image data is entered as YCbCr 8 -bit JPEG data 
will be described. It should be noted that Wide Gamut 
RGB is used as xRGB. 

10 Since the system configuration of the image data 

processing apparatus according to this embodiment is 
that same as that of the first embodiment, it need not 
be described here. 

Fig. 7 is a flowchart for describing a process 

15 through which a JPEG image is printed. At step S701, 
the print setting dialog screen 302 is opened by the 
user and the printing settings are made. This is 
followed by step S702, at which the user presses the 
print button 303 to start print processing. 

20 JPEG image data to be printed is decoded at step 

S703 to acquire 8 -bit YCbYr data. Next, at step S704, 
print settings (medium, printing mode, paper size), 
which have been made using the print setting dialog 
screen 302, are acquired. Then, at step S705, the 

25 color space and bit precision used at the time of 

printing are selected in accordance with the flowchart 
of Fig. 4 or 6. 
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It is determined at step S706 whether the 
selected color space and bit precision are Wide Gamut 
RGB and 16 bits, respectively. If the selected color 
space and bit precision are Wide Gamut RGB and 16 bits, 
5 respectively, then control proceeds to step S707. 
Otherwise, control proceeds to step S709. 

At step S707, the 8 -bit YCbCr data is converted 
to Wide Gamut RGB 16 -bit data. The conversion process 
at this time is indicated at conversion method 801 in 
10 Fig. 8. Next, at step S708, an image correction in 
order to enhance the appearance of the image data is 
performed with respect to the 16 -bit Wide Gamut RGB 
data. 

At step S709, the 8-bit YCbCr data is converted 
15 to sRGB 8-bit data. The conversion process at this 

time is indicated at conversion method 802 in Fig. 8. 
Next, at step S710, an image correction in order to 
enhance the appearance of the image data is performed 
with respect to the 8 -bit sRGB data. 
20 The corrected data is converted to Device RGB at 

step S711. Then, at step S712, Device RGB is 
converted to CMYK. Printing is executed at step S713 
using the CMYK data. 

Thus, even if the entered image data represents a 
25 JPEG image, print processing can be speeded up while 
suppressing a decline in tonality by converting the 
YCbCr data to xRGB 16-bit or sRGB 8-bit data in 
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dependence upon the type of printing media or 
resolution in a manner similar to that of the first or 
second embodiment . 

[Fourth Embodiment] 
5 The first to third embodiments are described 

taking as an example a printer serving as an image 
data processing apparatus (or a device connected to 
but separate from a printer) . The embodiments that 
follow will be described taking a digital camera as an 
10 example. A fourth embodiment of the present invention 
will be described first with reference to Figs. 9 to 
14. 

Fig. 10 is a diagram illustrating an example of 
the system configuration of a digital camera according 
15 to this embodiment. As shown in Fig. 10 , this system 
comprises an input unit 1001, a display unit 1002, a 
storage device 1003, a CPU 1004, a ROM 1005 and a RAM 
1006. 

The input unit 1001 is for entering commands and 
20 data from a user and includes a pointing system such 
as a keyboard and mouse . 

The display unit 1002, which is a device that 
displays a GUI and the like, usually employs a CRT or 
liquid crystal display. 
25 The storage device 1003 stores image data and 

programs and usually employs a hard disk. 
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The CPU 1004 controls the overall operation of 
the system, executes processing involving the 
components mentioned above and executes image data 
processing according to this embodiment . 
5 The ROM 1005 and a RAM 1006 are utilized as 

storage areas for programs relating to processing for 
various control, areas for storing image data, and 
working areas for various processing. 

A control program 1007 for image data processing 

10 shown in Figs. 9 and 15, which will be described later, 
can be stored in the storage device 1003 or ROM 1005. 
In a case where the program has been stored in the 
storage device 1003, the program is executed upon 
being read into the RAM 1006 temporarily. 

15 It should be noted that the system configuration 

of the image data processing apparatus according to 
this embodiment includes various components (e.g., 
image sensing means and the like) other than those 
mentioned above. However, these other components are 

20 not described here. 

Fig. 11 illustrates an external view of a digital 
camera in which captured image data is acquired as a 
JPEG file. 

A bit precision of a JPEG file is usually fixed 
25 to eight bits. Therefore, in the case of the digital 
camera in which captured image data is acquired as a 
JPEG file in the present embodiment, it is necessary 
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to select whether tonality or color gamut is to be 
emphasized. 

A digital camera 1100 is provided with a mode 
dial 1103 for changing the mode of photography. A 
5 change can be made to any of four photography modes at 
the time of photography by turning the mode dial 1103. 

Figs. 12A to 12D illustrate an example of 
photography modes selected by the mode dial 1103. 
These modes include a portrait mode 1201 for 

10 photographing a person, a scenery mode 1202 for 

photographing scenery, a night scenery mode 1203 for 
photography a night scene, and an automatic mode 1204 
used to photograph most other scenes. (In other words, 
the mode of photography is changed over in accordance 

15 with the scene photographed. ) 

Whenever the mode dial 1103 is turned, the mode 
of photography changes and the mode currently selected 
is displayed in the form of an icon representing a 
selected mode 1105 on a liquid crystal panel 1104. 

20 By pressing a shutter-release button 1102, a 

picture is taken according to the currently selected 
mode of photography and a JPEG file is obtained. 

Fig. 13 illustrates a back side 1301 of the 
digital camera 1100. The back side 1301 of the 

25 digital camera 1100 is provided with a liquid crystal 
display 1302. A UI (User Interface) for setting the 
digital camera 1100 in various ways is displayed on 
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the liquid crystal display 1302. The UI is operated 
using operating buttons 1304a to 1304d. 

Fig. 14 illustrates an example of an operating 
screen 1305 for setting a color space mode. In order 
5 to change over the color space at the time of 

photography, an sRGB mode 1401, an Adobe RGB mode 1402 
and an automatic select mode 1403 are displayed on the 
operating screen 1305. The sRGB mode 1401 is a mode 
for executing color correction processing using sRGB 

10 color space, and the Adobe RGB mode 1402 is a mode for 
executing color correction processing using Adobe RGB 
color space. The sRGB color space and the Adobe RGB 
color space are defined by color gamuts of the kind 
shown in Fig. 16 mentioned earlier. 

15 When these color spaces are selected, the UI of 

the operating screen 1305 is displayed on the liquid 
crystal display 1302 and a color space can be 
designated by selecting it from among the three color 
spaces 1401 to 1403. 

20 In a case where the automatic select mode 1403 

has been selected, the content of the data obtained by 
photographing the subject is evaluated and whether 
tonality should be emphasized or gamut emphasized is 
recognized automatically giving primary consideration 

25 to the setting of the photography modes 1201 to 1204. 
The operation of this apparatus will now be 
described. 
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Fig, 9 is a flowchart of image data processing in 
the image data processing apparatus (digital camera) 
according to this embodiment. This embodiment will be 
described with regard to color correction processing 
5 in a case where the automatic select mode 1403 has 

been selected as the color space when photographing a 
subject by the digital camera 1100. 

The automatic select mode 1403 is set as the 
color space using the operating screen 1305 at step 
10 S901. 

Shutter-release button 1303 is pressed at step 
S902 in order to photograph the subject. 

Next, the subject is photographed using an image 
sensing device such as a CCD sensor and an optical 
15 signal that is the captured data is converted to an 
RGB digital signal to obtain digital image data at 
step S903. 

Interpolation processing and a white-balance 
adjustment are applied to the digital image data at 
20 step S904. 

This is followed by step S905, at which the 
photography mode used in photography is read from the 
selected mode 1105 of the liquid crystal panel 1104. 
It is determined which of the photography modes 1201 
25 to 1204 of Figs. 12A to 12D has been read. 

Next, at step S906, the photography mode and the 
color space mode at the time of photography and the 
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content of the captured image data are analyzed and it 
is judged from the results of analysis whether 
tonality or color gamut is to be emphasized. 

More specifically, since the automatic select 
5 mode 1403 has been set as the color space, the 
determination as to whether tonality is to be 
emphasized is decided giving precedence to the set 
content of the photography mode prevailing at this 
time. As a result, if the photography mode at the 

10 time of photography is the portrait mode 1201, for 
example, it is judged that tonality is to be 
emphasized and control proceeds to step S907. 

On the other hand, if it is found at step S906 
that the scenery mode 1202, night scenery mode 1203 or 

15 automatic mode 1204 has been selected as a mode other 
than the portrait mode, then it is judged that a wider 
color gamut is to be emphasized and control proceeds 
to step S910. 

A 3 x 3 matrix operation is applied to the image 

20 data at step S907 as an n x m matrix operation (where n, 
m are integers) for sRGB color space to achieve a 
color correction to sRGB color space. As a result, 
the image data is converted to fall within an area 
1601 bounded by the dashed line of sRGB color space in 

25 Fig. 16. 

A 3 x 3 matrix operation is applied to the image 
data at step S910 as an n x m matrix operation (where n. 
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m are integers) for Adobe RGB color space to achieve a 
color correction to Adobe RGB color space. As a 
result, the image data is converted to fall within an 
area 1602 bounded by the solid line of Adobe RGB color 
5 space in Fig. 16. 

As will be obvious from Fig. 16 , Adobe RGB color 
space has a color gamut wider than that of sRGB color 
space. Therefore, if the bit precisions are the same, 
tonality in sRGB color space will be 140% higher than 

10 tonality in Adobe RGB color space. 

A gamma correction for the monitor is applied to 
the color-corrected image data at step S908. 

This is followed by step S909, at which the 
color-corrected image data is subjected to JPEG 

15 compression and then stored as a file. It should be 
noted that the photography mode that was used in 
photography is appended to the file header as 
additional information when the data is stored. 

Thus, in accordance with this embodiment as 

20 described above, the photography mode and the color 

space mode at the time of photography and the content 
of the captured image data are analyzed, it is judged 
from the results of analysis whether the subject is a 
person and whether tonality or color gamut is to be 

25 emphasized can be identified automatically. If the 
result of such processing of the image data a 
determination that a person is the subject, then image 
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data having rich tonality can be created. If it is 
determined that scenery is the subject, then image 
data in which a rich color gamut can be reproduced can 
be created. 

5 A modification of this embodiment will now be 

described. In a case where the automatic select mode 
1403 has been set as the color space mode and, 
moreover the automatic mode 1204 has been set as the 
photography mode, it will suffice to execute the 

10 analysis processing of step S906 in Fig. 9 as follows: 
The content of the data representing the 
photographed subject is analyzed and the color space 
is changed over automatically on the side of the 
digital camera in accordance with the analytical 

15 result. For example, the content of the photography 

data is analyzed, with focal length, magnification and 
shutter speed, etc., being included in the analysis. 
If it is judged that the data is data in which a human 
being is the main subject, sRGB color space 

20 emphasizing tonality is selected. If it is judged 
that the data is data in which the main subject is 
other than a human being, e.g., scenery, then Adobe 
RGB color space emphasizing color gamut is selected. 
Color correction processing is then executed at step 

25 S907 or S910 using the color space selected. 
[Fifth Embodiment] 
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Next, a fifth embodiment of the present invention 
will be described with reference to Fig. 15. 
Components identical those of the fourth embodiment 
described above are designated by like reference 
5 characters and need not be described again. 

This embodiment will be described in regard to 
another example of image data processing, namely color 
correction processing for a case where the Adobe RGB 
mode 1402 has been selected as the color space and the 
10 portrait mode 1201 as the photography mode when a 

subject is photographed by the digital camera 1100. 

The color space is set to the Adobe RGB mode at 
step S1501 using the selected mode 1105. 

Shutter-release button 1303 is pressed at step 
15 S1502 in order to photograph the subject. 

Next, the subject is photographed using an image 
sensing device such as a CCD sensor and an optical 
signal that is the captured data is converted to an 
RGB digital signal to obtain digital image data at 
20 step S1503. 

Interpolation processing and a white-balance 
adjustment are applied to the digital image data at 
step S1504. 

This is followed by step S1505, at which the 
25 portrait mode 1201 is read as the photography mode 
used in photography. 
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Next, at step S1506, the photography mode and the 
color space mode at the time of photography and the 
content of the captured image data are analyzed and it 
is judged from the results of analysis whether 
5 tonality or color gamut is to be emphasized. 

More specifically, since the photography mode at 
the time of photography is the portrait mode 1201, it 
is judged that a wider color gamut is to be emphasized 
and control proceeds to step S1511. However, since 
10 this processing is outside the scope of this invention, 
it will not be described here. 

A 3 x 3 matrix operation is applied to the 
manipulated image data (referred to as "image data A" 
below) at step S1507 as an n x n matrix operation for 
15 sRGB color space to achieve a color correction to sRGB 
color space. As a result, the image data is converted 
to fall within an area 1601 bounded by the dashed line 
of sRGB color space in Fig. 16. 

A gamma correction for the monitor is applied to 
20 the color-corrected image data A at step S1508. 

The image data A is subjected to JPEG compression 
and then stored as a file at step S1509. When the 
data is stored, the photography mode used in 
photography is attached to the file header as 
25 additional information. 

It is checked at step S1510 whether the color 
space specified at step S1501 and the color space that 
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has actually undergone the color correction at step 

S1507 are the same. 

If the result of the check is that the two color 

spaces are the same, processing is exited. On the 
5 other hand, if the result of the check is that the two 

color spaces are not the same, control proceeds to 

step S1511. 

A 3 x 3 matrix operation is applied to the 

manipulated image data (referred to as "image data A" 
10 below) at step S1507 as an n x n matrix operation for 

Adobe RGB color space to achieve a color correction to 

Adobe RGB color space. The image data generated as a 

result of the color correction is adopted as image 

data B. The image data B is converted to fall within 
15 an area 1602 bounded by the solid line of Adobe RGB 

color space in Fig. 16. 

As will be obvious from Fig. 16, Adobe RGB color 

space has a color gamut wider than that of sRGB color 

space. Therefore, if the bit precisions are the same, 
20 tonality in sRGB color space will be greater than that 

in Adobe RGB color space. 

The image data B is thenceforth subjected to 

processing at step S1510. Now since the color space 

specified at step S1501 and the color space that has 
25 actually undergone color correction at step S1511 are 

both same, i.e., Adobe RGB color space, processing is 

exited. 
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If the result of the above processing is that 
Adobe RGB color space has been specified at step S1501 
and that the photography mode is the portrait mode 
1201, then processing is executed in the following 
5 order: S1506, S1507, S1508, S1509, S1510, S1511, 

S1508, S1509, S1510, END. As a result, two types of 
image files are generated, namely an image file of 
image data A color-corrected to sRGB color space and 
an image file of image data B color -corrected to both 

10 sRGB color space and Adobe RGB color space. 

Consequently, the image data A that has been 
color-corrected to the sRGB color space also can be 
stored even in a case where a decline in tonality 
appears in the image data B that has been color- 

15 corrected to Adobe RGB color space specified by the 

user. This makes it possible to rescue precious data 
acquired by photography. 

A modification of this embodiment will now be 
described. Assume a case where a person is 

20 photographed at a party or the like in a room at night. 
If the Adobe RGB mode 1402 has been selected as the 
color space and the night scenery mode 1203 as the 
photography mode in this case, then, in case of 
ordinary processing, it may seem that it will be 

25 determined at step S1506 that the subject is other 

than a person because the night scenery mode 1203 has 
been set, and that control will proceed to step S1511 
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and only one item of image data color-corrected to 
Adobe RGB color space will be generated. 

However, in the analysis processing at step S1506 
in this embodiment, a judgement is rendered not only 
5 based upon the photography mode. Skin-color 

recognition is performed by identifying, from hue 
information for discriminating skin color, whether the 
photographic data contains a skin-color portion. 
Furthermore, the area in which the skin color resides 

10 is specified based upon the result of this skin-color 
recognition and this area is approximated by an oval. 
Then, face recognition is carried out by identifying 
whether i) a pair of eye areas is present at a 
prescribed position in this oval or whether ii) an 

15 organ such as the nose or mouth is present at a 

prescribed position in the oval. Information relating 
to the content of the photographic data obtained as a 
result of such face recognition and the content of the 
color space mode setting are subjected to overall 

20 analysis simultaneously and it is determined which of 
tonality or color gamut should be emphasized. 
Therefore, even though the night scenery mode 1203 has 
been set, control proceeds to step S1507 in a case 
where the result of analysis at step S1506 is a 

25 judgement that a person is the main subject. Upon 

generation of one item of image data A that has been 
color-corrected to sRGB color space (because the color 
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space is different at step S1510), control proceeds to 
step S1511. Now one more item of image data, namely 
image data B, that has been color- corrected to Adobe 
RGB color space is generated. The end result, 
5 therefore, is that two types of image data exist. 

Thus, in accordance with this example, it is 
possible to generate a realistic, subtle image in line 
with the photographic conditions irrespective of the 
color space mode set by the operator. 

10 [Other Embodiments] 

The present invention can be applied to a system 
constituted by a plurality of devices (e.g., a host 
computer, interface, reader, printer, etc.) or to an 
apparatus comprising a single device (e.g., a copier 

15 or facsimile machine, etc.). 

Furthermore, it goes without saying that the 
object of the invention is attained also by supplying 
a storage medium storing the program codes of the 
software for performing the functions of the foregoing 

20 embodiments to a system or an apparatus, reading the 
program codes with a computer (e.g., a CPU or MPU) of 
the system or apparatus from the storage medium, and 
then executing the program codes . 

In this case, the program codes read from the 

25 storage medium implement the novel functions of the 

embodiments and the storage medium storing the program 
codes constitutes the invention. 
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Examples of storage media that can be used for 
supplying the program code are a floppy disk, hard 
disk, optical disk, magneto-optical disk, CD-ROM, CD-R, 
magnetic tape, non-volatile type memory card or ROM, 
5 etc. 

Furthermore, besides the case where the aforesaid 
functions according to the embodiments are implemented 
by executing the program codes read by a computer, it 
goes without saying that the present invention covers 
10 a case where an operating system or the like running 
on the computer performs a part of or the entire 
process in accordance with the designation of program 
codes and implements the functions according to the 
embodiments. 

15 It goes without saying that the present invention 

further covers a case where, after the program codes 
read from the storage medium are written in a function 
expansion board inserted into the computer or in a 
memory provided in a function expansion unit connected 

20 to the computer, a CPU or the like contained in the 
function expansion board or function expansion unit 
performs a part of or the entire process in accordance 
with the designation of program codes and implements 
the function of the above embodiments. 

25 The present invention is not limited to the above 

embodiments and various changes and modifications can 
be made within the spirit and scope of the present 
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invention. Therefore to apprise the public of the 
scope of the present invention, the following claims 
are made. 
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